Atty. Dkt. No. 016778/0407 



so 

SO 



:0 



Examiner 
Art Unit: 



IN THE UNITED STA TES PA TENT AND TRADEMARK OFFICE 

Applicant: Daigo TAGUCH1, et al. 

Title: SCENARIO EDITING DEVICE 

CAPABLE OF AUTOMATICALLY 
SUPPLEMENTING SCENARIO ON 
THE BASIS OF RECEIVED 
ADDITIONAL DATA 

Serial No.: Unassigned 

Filing Date: March 7, 2000 

Unassigned 

Unassigned 

UTILITY PATENT APPLICATION 
TRANSMITTAL 

Assistant Commissioner for Patents 
Box PATENT APPLICATION 
Washington, D.C. 20231 

Sir: 

Transmitted herewith for filing under 37 C.F.R. § 1 .53(b) is the nonprovisional 
utility patent application of: 

Daigo TAGUCHI 
Hisashi NODA 

Enclosed are: 

[ X ] Specification, Claim(s), and Abstract (28 pages), 

[ X ] Informal drawings (12 sheets, Figures 1-1 2D). 

[ X ] Declaration and Power of Attorney (2 pages). 

[ X ] Assignment of the invention to NEC CORPORATION. 

[ X ] Assignment Recordation Cover Sheet. 



o = 

ND<= 5 



go 
5r> 



002.312123.1 



Atty. Dkt. No. 016778/0407 



The filing fee is calculated below: 



Claims Included in Extra Fee 

as Filed Basic Fee Claims Rate Totals 



Basic Fee 






$690.00 


$690.00 


Total Claims: 24 - 20 = 


4 


X 


$18.00 


$72.00 


Independents: 3 - 3 = 


0 


X 


$78.00 = 


$0.00 


If any Multiple Dependent Claim(s) present: 




+ 


$260.00 


$0.00 


Assignment Recordation fee per property 






$ 40.00 


$ 40.00 








SUBTOTAL: = 


$802.00 


[ ] Small Entity Fees Apply (subtract M> 


of above): = 


$0.00 




TOTAL FILING FEE: = 


$802.00 



[ X ] A check in the amount of $802.00 to cover the filing fee is enclosed. 



[ ] The required filing fees are not enclosed but will be submitted in response to the 
Notice to File Missing Parts of Application. 

[ X ] The Assistant Commissioner is hereby authorized to charge any additional fees 
which may be required regarding this application under 37 C.F.R. §§1 .16-1 .17, 
or credit any overpayment, to Deposit Account No. 19-0741 . Should no proper 
payment be enclosed herewith, as by a check being in the wrong amount, 
unsigned, post-dated, otherwise improper or informal or even entirely missing, 
the Assistant Commissioner is authorized to charge the unpaid amount to 
Deposit Account No. 1 9-0741 . 

Please direct all correspondence to the undersigned attorney or agent at the 
address indicated below. 

Respectfully submitted, 



Date March 7, 2000 

FOLEY & LARDNER 
Washington Harbour 
3000 K Street, N.W., Suite 500 
Washington, D.C. 20007-5109 
Telephone: (202) 672-5407 
Facsimile: (202) 672-5399 



By 



fey 



David A. Blumentha) 
Attorney for Applicant 
Registration No. 26,257 



002.312123.1 



-2- 



SCENARIO EDITING DEVICE 
CAPABLE OP AUTOMATICALLY SUPPLEMENTING SCKNAKJQ 
ON THE BASIS OF RECEIVED ADDITIONAL DATA 



BACKGROUND OF THE INVENTION; 

T*xis invention relates to a scenario editing device which 
is for ©cutting a scenario of multimedia contents. 

The multimedia contents include a plurality of materials 
represented by multimedia data. The multimedia data includes 
at least one data set such as an image data set (or still picture 
data set) , a video data set (or moving picture data set ox 
animation data set) , an audio data set, or a text dU*ta set. A 
scenario defines a concrete form of presenting or exhibiting 
the multimedia contents. In other wards, the scenario defines 
displaying position and timing of text and images and 
reproducing audio and video. The multimedia contents is 
provided to a computer with a recording medium such as a CD -ROM 
or through a computer network such as an internet. Then, the 
multimedia contents is presented or exhihit to clients with the 
computer . 

As is easily understood from the description mentioned 
above, the scenario is necessary to present or exhihit the 
multimedia contents to the clients. 

A conventional scenario editing device produces and edits 
the scenario in response to instructions given hy an operator . 
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The operator prepares multimedia data to complete the* 
multimedia contents and produce the scenario so that the 
prepared iflultimedia data is included in the multimedia 
contents • 

By the way, it desired to automatically supplement a 
scenario of incomplete multimedia contents recently when the 
scenario editing device receives additional multimedia data 
which are necessary to complete the incomplete multimedia 
contents . 

However , the conventional scenario editing device can not 
automatically supplement the scenario oJ£ the multimedia 
contents on the basis of the additional multimedia data because 
it needs the instructions given by the operator to supplement 
(or edit) the scenario. 



SUMMARY OF THE INVENTION: 

It is therefore an oh j ect of this invention to provide 
a scenario editing device which can automatically supplement 
a scenario of multimedia contents when it receives an additional 
data set which is necessary to complete the multimedia contents . 

Other object of this invention will become clear as the 
description proceeds. 

On describing the gist of this invention, it is possible 
to understand that a scenario editing device edits a scenario 
of multimedia contents which include a plurality o£ materials 
represented by data sets » 

According to the gist of this invention,, the scenario 
editing device comprises a scenario memory for memorizing the 
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scenario. A scenario rule memory memorises a scenario basic 
rule which defines specifications of a complete state of the 
multimedia contents. A receiving" "unit receives an additional 
delta set which represents an additional material necessary to 
complete the multimedia contents . A scenario supplementing 
unit is connected to the scenario memory, the scenario rule 
memory, and the receiving unit and supplements the scenario 
according to the scenario basic rule so that the additional 
material is included: in the multimedia contents to make the 
multimedia contents approach the complete state. 

According to another gist of this invention,, a scenario 
editing device edits a scenario of multimedia contents which 
are presented to a client through a computer network and which 
include a plurality of materials represented by data sets , The 
scenario editing device comprises a scenario memory for 
memorising the scenario. A presenting section is connected to 
the scenario memory and the computer network and presents the 
multimedia contents to the client by the use of the scenario 
memorized in scenario memory. A receiving unit receives an 
additional data set which is supplied from the client and which 
represents an additional material . A scenario supplementing 
unit is connected to the scenario memory and the receiving unit 
for supplementing the scenario memorized in the scenario memory 
so that the additional material represented by the additional 
data set is included in the multimedia contents - 

According to still another gist of this invention , a 
recording medium in which a computer readable program is 
recorded. The computer readable program comprises the steps 
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of memorising, in a scenario memory, a scenario of multimedia 
contents which include a plurality of materials represented toy 
data sets, memorizing, in a scenario rule memory, a scenario 
basic rule which defines specifications of a complete state of 
the multimedia contents, receiving, by a receiving unit, an 
additional data set which represents an additional material 
necessary to complete the multimedia contents , and 
supplementing, at a scenario supplementing unit, the scenario 
according to the scenario basic rule so that the additional 
material is included in the multimedia contents to make the 
multimedia contents approach the complete state* 

BRIEF DESCRIPTION OP THE DRAWING: 

Pig. 1 is a block diagram of a conventional scenario 
editing device ; 

Pig, 2 is a flow chart for describing an operation of the 
conventional scenario editing device of Pig. 1; 

Fig. 3 is a block diagram of a scenario editing device 
of a preferred embodiment of this invention; 

Figs . 4 A and 4B show an example of a complete state of 
multimedia contents ; 

Figs . 5A and 5B show an example of an incomplete 
multimedia contents ; 

Pigs. €A, 6B, and 6C show a form of a scenario memorized 
in a scenario memory; 

Pig. 7 shows a form of a scenario ibasic rule memorized 
in scenario rule memory; 
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Fig. 8 slices a form of a scenario complete degree 
information ; 

Figs . and 9B show the incomplete multimedia contents 
presented by the WWW browser; 

Fig. 10 shows an example of an electronic mail sent from 

a clients 

Fig. 11 show a form of a supplier information memorized 
in supplier information memory; 

Figs. 12A, 12B/ 12C, and 12D show an example of 
supplemented scenario; 

Fig. 13 shows a renewed scenario complete degree 

information; and 

Figs . 14A and 14B show supplemented multimedia contents - 

DESCRIPTION OF THE PREFERRED EMBODIMENT: 
Referring to Figs- 1 and 2 , description will he at first 
directed to a conventional scenario editing device for a better 
understanding of this invention. The scenario editing device 
is used for producing and editing a scenario which defines 
presenting positions and timing of multimedia contents formed 
by materials represented by multimedia data in response to 
instructions given by an operator. 

In Fig- 1, the conventional scenario editing device 
comprises an input/ output unit 101 which receives commands and 
the multimedia data from the operator . The multimedia data, are , 
for exampl© , ixoage data sets, video data sets, text data sets, 
and audio data sets • The commands are for given the instruction 
to the scenario editing device . A multimedia data memory 102 



.1 ' Jl 



R8C8iV8d 03-07-00 04:30 From-81 335030250 To-FOLEY AND LARDNER Page 10 



6 

memorizes the multimedia data* A scenario editing unit 103 
produces and edits the scenario on the basis o£ the multimedia 
data in response to the commands , A scenario memory 104 
memorizes the scenario. A scenario expanding unit 105 expands 
the scenario which includes a sub-scenario to edit the scenario • 
A data control unit 106 is connected to the input/output unit 
101, the multimedia data memory 102, the scenario editing unit 
103, the scenario memory 104, and the scenario expanding; unit 
105 to control flows of the commands , the multimedia data and 
tlie scenario- A work memory 107 is connected to the scenario 
editing unit 103 r the scenario expanding unit 105 r and the 
input/ output tmit 101 to temporarily store tlie scenario. 

The scenario editing device operates as shown in Fig. 2 
when a command is supplied from the operator to the input/output 
unit 101. 

At the step £201, the input/ output unit 101 decides 
whether the received command relates to the multimedia data or 
the scenario. When the received command relates to the 
multimedia data, the input/output unit 101 receives the 
multimedia data from the operator at the step S202 and transmits 
the multimedia data to the multimedia data memory 102 through 
the data control unit 106* The multimedia data memory 102 
memorizes tlie multimedia data transmitted from the input/output 
unit 101 at the step S203 , 

On the other hanc\, when tne received command relates to 
the scenario, the input/ output unit 101 judges substance of the 
received command at the step S204. 
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If the received command instructs the scenario edi.-bo.ng; 
device to produce tlie scenario, the input/output -unit 101 orders 
the data, control unit 10 6 and the scenario editing- unit 103 to 
produce the scenario. When the data control unit 106 receives 
the scenario producing order from the input/ output unit 101, 
it Treads out the multimedia data from the multimedia, data memory 
102 and transmits the multimedia data to the scenario editing; 
unit 103 . The scenario editing unit 103 receives the multimedia 
data from the data control unit 106 and produces the scenario 
at the step S205. In this event, the scenario editing unit 103 
receives the commands given from the operator through the 
input/ output unit 101. Then, the scenario editing unit 103 
transmits the produced scenario to the scenario memory 104 
through the data control unit 106. The scenario memory 10 4 
memorizes the produced scenario supplied form the scenario 
editing unit 103. 

If the received command instructs the scenario editing 
device to edit the scenario memorised in the scenario memory 
104, the input/output unit 101 orders the data control unit 10 6 
and the scenario editing unit 103 to edit the scenario* When 
the data control unit 106 receives the scenario editing order 
from the input/output unit 101, it reads out the scenario from 
the scenario memory 104 and transmits the scenario to the 
scenario editing unit 103. The scenario editing unit 103 
receives the scenario from the data control unit 106 and edits 
the scenario in response to the commands given hy the operator 
at the step B20S . Then, the scenario editing unit 103 transmits 
the edited scenario to the scenario memory 104 through the data 
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control unit 106 . The scenario memory 104 memorized the edited 
scenario . 

X£ the received command, instructs the scenario editing 
device to expand the scenario memorised in the scenario memory 
104 , the input/ output unit 101 orders the data control unit 106 
to expand the scenario. Vttien the data, control unit 106 receives 
the scenario expanding order from the input/ output unit 101/ 
it reads out the scenario from the scenario memory 104 and 
transmits the scenario to the scenario expanding unit 105 . The 
scenario expanding unit 105 receives the scenario from the data 
control unit 106 and expands the scenario at the step S207 . Then r 
the scenario expanding unit 105 stores the expan<ied scenario 
into the woxrk memory 107 . The scenario editing unit 103 can 
edit the expanded scenario stored in the work memory 107 . 

As mentioned above / the conventional scenario editing 
device produces and edits the scenario on the basis of the 
previously provided multimedia data in response to the commands 
supplied from the operator* Such scenario editing device is 
disclosed in Japanese Unexamined Patent Publication (JF-A) No. 
3-305720, 

By the way, it is desired to automatically edit or 
supplement the scenario of multimedia contents when the 
scenario editing device receives additional multimedia data 
which is necessary to complete the multimedia contents . For 
example, there is a case where a teacher presents or exhibits 
incomplete multimedia contents to his/her students using* a 
temporary scenario through a computer network and requests the 
students to supply the additional multimedia data, for 
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completing the multimedia contents. Xn this case, the teacher 
desires that the scenario editing device can automatically 
supplement the temporary scenario on the basis of the additional 

multimedia data. 

However r the conventional scenario editing- device needs 
the commands from the operator to receive the additional 
multimedia data and to edit the scenario. That is, the 
conventional scenario editing device does not have a setting 
section for supplementing information that is necessary to 
automatically supplement the scenario r a list producing section 
for producing a lacking multimedia data list on the basis of 
the supplement information, a presenting section for presenting 
the incomplete multimedia contents to clients, a scenario 
supplementing section for receiving the additional multimedia 
data provided by the clients and for completing the scenario 
on the basis of the additional multimedia data and the 
supplement information/ and a contents completing section for 
changing the incomplete multimedia contents into complete 
multimedia contents . 

Referring to Figs. 3 through 14, the description will 
proceed to a scenario editing device according to a preferred 
embodiment of this invention. The scenario editing device is 
realized with, for example , a personal computer which is 
connected to a computer network such as an internet. In other 
wards, the scenario editing device is realized a program which 
can be read snd executed by the personal computer* 

Tn Fig. 3, the scenario editing device comprises an input 
device 301 . The input device is , for example r a Jceyboard. or 
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a mouse - The input device maybe a combination of the keyboard/ 
the mouse, and so on. The input device 301 is operated by an 
operator no input commands • The commands instructs the 
scenario editing device to receive multimedia data 
representative of materials of multimedia contents , to delete 
disused multimedia, data, and to designate presenting or 
exhibiting positions and timing of the materials. The 
multimedia data includes an audio data set, a video data set, 
an image data set, and a text data set. An output device 302 
is , fox example , a display unit and displays the multimedia data , 
the multimedia contents, and necessary information for the 
inputting operation for the input device 301. An input/output 
control unit 303 is connected to the input device 301 and the 
output device' 302 to control signals supplied from -the input 
device 301 and other signals supplied to the output device 302 ► 
When the input/output control unit 303 receives the c omman ds 
from the input device 301 , it produces operating information* 
A; scenario editing unit 304 is connected to the input/output 
control unit 303 to produce and edit a scenario of the multimedia 
contents on the basis of the operating information supplied from 
the input/output control unit 303. a scenario memory 305 is 
connected to the scenario editing unit 304 to memorise the 
scenario produced and edited by the scenario editing unit 304 
together with the multimedia data relating to the scenario. A 
scenario rule editing unit 306 is connected to the input/ output 
control -unit 303 to produce and edit a scenario basic rule on 
the basis of the operating information supplied from the 
input/output control unit 303 . The scenario basic rule is used 
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for au t oma t i cal ly supplementing the scenario . A scenario nale 
memory 307 is connected to the scenario rule editing unit 306 
to memorize "Clie scenario basic rule produced and edited by the 
scenario rule editing unit 306. A scenario analyzing unit 308 
is connected to the scenario memory 305 and the scenario rule 
memory 307 and analyzes the scenario memorized in the scenario 
memory 305 with referring to tne scenario basic rule memorized 
in the scenario memory 307 to produce a. scenario complete degree 
information- The scenario complete degree information 
includes a scenario complete rat© information representative 
of a complete rate o£* the multimedia content© and a lucking data 
list representative of lacking data sets for a complete state 
of the multimedia contents? - A scenario complete degree memory 
309 is connected to the scenario analysing unit 308 to memorize 
the scenario complete degree information, A scenario 
converting unit 310 is connected to the scenario memory 305, 
the scenario rule memory 307, and the scenario complete degree 
memory 309. The scenario converting unit 310 converts the 
scenario memorized in the scenario memory 305 into an exhibiting 
electronic document with referring to the scenario basic rule 
memorised in the scenario memory 307 to exhibit an incomplete 
multimedia contents . The incomplete multimedia contents 
includes the scenario complete degree information memorized in 
the scenario complete degree memory 309 - A. connecting unit 311 
is connected to the scenario converting unit 310 and the 
computer network and exhibits the incomplete multimedia 
contents on the computer network to present the incomplete 
multimedia contents to clients through the computer network. 
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The scenario converting unit 310 and the connecting -unit 311 
are called a presenting section for presenting the multimedia 
contents to the clients, ivn additional data, receiving unit 312 
ie for receiving an additional data set and supplier information 
from the clients. The additional data receiving unit 312 
includes , £or example , a email receiving client software , a 
floppy disk drive for a floppy or flexible magnetic disfc, an 
optical disk drive for an optical disk or a optical magnetic 
disk/ a memory reader for a semiconductor memory , a modem or 
a terminal adapter connected to the computer network , or a 
scanner for scanning a printed matter . A scenario 
supplementing unit 313 is connected to the scenario memory 305 r 
the scenario rale memory 307 , and the additional data receiving 
unit 312 and produces an additional scenario according to the 
scenario basic rule memorized in scenario rule memory 307 and 
the additional data set received i?y the additional data 
receiving unit 312 to supplement the scenario memorised in the 
scenario memory 305 with the additional scenario. Moreover, 
the scenario supplementing unit 313 adds the additional data 
set received toy the additional data receiving unit 312 to the 
multimedia data memorised in the scenario memory 305. An 
supplier information memory 314 is connected to the additional 
data receiving unit 312 and the connecting unit 311 and 
memorized the supplier information received hy the additional 
data receiving unit 312 to supply the supplier information to 
the connecting uxut 311 _ 

An operation of the scenario editing device is described 
soon with referring to Figs 4 to 14 together with Fig. 3. 
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At first, the operator makes a concrete idea of the 
complete state of the multimedia contents as illustrated in Figs . 
4A and. 4B , The multimedia contents includes a table of contents 
shown in Fig. 4A and content pages shown in Fig. 4B. The table 
©£ Fig, 4A has items of spots of A, B, C, and D and years of 
1970 , 1980, 1990, and 2000- Tin© table includes link buttons 
corresponding to combinations of points and years - Each or the 
link buttons is related to one of the content pages of Fig. 4B . 
Each of the content pages includes a title, a picture, and a 
caption - 

Next, the operator makes temporary multimedia contents 
which lacks a part of the materials of the complete multimedia 
contents. When all of the materials is not gathered, the 
operator makes the temporary multimedia contents, Moreover, 
the operator makes the temporary multimedia contents so that 
the clients tries to gather the lacking materials. 

To make the temporary multimedia contents , the operator 
operates the input device 301, The operator inputs the 
multimedia data representative of provided materials and 
instructs presenting position and timing by the use of input 
device 301. The input device 30X supplies the multimedia data 
and commands corresponding to the instructions . 

The input/output control unit 303 produces the operating 
information in response the commands supplied from the input 
device 301 and supplies the operating information to the 
scenario editing 1 unit 304 . 

The scenario editing unit 304 produces the scenario for 
the temporary multimedia contents and stores the scenario into 
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the scenario memory 305 «. 

An example of the temporary multimedia contents is shown 
In Figs. 5A and 5B. Namely, the temporary multimedia contents 
includes a table of contents shown in Fig. 5A and a content page 
shown in Fig. 5B. The table of Fig. 5A has an only one linfc 
bottom which is related to the content page of Fig. SB. In this 
case, the scenario memory memorizes the scenario of the form 
as shown in Figs. 6A, SB, and 6C. That is, the scenario has 
a main table shown in Fig . 6 A. and two data table shown in Figs - 
6B and 6C, The data table 001 of Fig. 6A is corresponding to 
the table of the contents of Fig. 5A while the data table 002 
of Fig. 6B is corresponding to the content page of Fig. 5B. 

ISeact, the operator inputs necessary information for 
making the scenario basic anale at the scenario rule editing "unit 
306 . The scenario rule editing unit 306 receives the 
information from the input device 301 through the input/output 
control unit 303 and produce the scenario basic rule. The 
scenario rule memory 307 memorizes the scenario basic rule made 
fay the scenario rule editing unit 306. 

The scenario basic rule includes rules of, for example, 
M The number of the content pages are sixteen in the complete 
state.", "The con-tent: pages are classified on the basis of 
combinations of spots and years . " , "Positions of the linfc 
bottoms a=e decided by an equation F.", etc. For example, the 
scenario basic rule memorised in the scenario rule memory 307 
has s. form as shown in Fig- 7 - Additionally, the scenario basic 
rule may be written with script language (i.e. simple 
programming language , e.g. JavaScript) which can be handled by 
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the scenario analysing unit 308 , the scenario converting unit 
310 , and scenario supplementing unit 313 - IF the scenario basic 
rule includes enough substance to form the scenario for the 
complete multimedia contents, it is unnecessary for the 
operator to make the temporally multimedia contents. 

When the scenario basic rule memorized in the scenario 
rule memory 307, the scenario analyzing unit 308 reads out the 
scenario from the scenario memory 305 „ Then the scenario 
analyzing 308 recognizes that: the scenario memorized in the 
scenario memory 305 includes pages of OF CONTENTS" and 

^SPOT C r 1980" . Moreover , the scenario analyzing 308 readis out 
the scenario basic rule from the scenario memory 307 and 
produces the scenario complete degree information on the basis 
of the scenario with referring to the scenario basic rule . The 
scenario complete degree information is r for example , as shown 
in Pig. 8 . In Pig, 8 , the lacking data list shows lac3c of fifteen 
pages . The scenario complete rate information shows that one 
sixteenth of the multimedia contents is finished. 

When the scenario complete degree information is stored 
in the scenario complete degree memory 309, the scenario 
converting unit 310 reads out the scenario from the scenario 
memory 305 and recognizes that the data table 001 corresponds 
to the scenario of the table of the contents on the basis of 
the main table of Fig. 6A . Furthermore r the scenario converting 
unit 310 reads out the scenario complete degree information from 
the scenario complete degree memory 30 9 and specifies the 
lacking pages on the basis of the lacking data list included 
in the scenario complete degree information . In addition, the 
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scenario converting unit 310 reads ovt the scenario basic ruie 
from the scenario rule memory 307 and recognizes locations of 
the link buttons relating to the lacking pages* Then the 
scenario converting unit 310 changes the scenario so that marks 
such as open circles are located in place of* the link buttons 
corresponding to the lacking page. The scenario converting 
-unit 310 further changes the scenario so that a Teeniest sentence 
is included in the page of the title of the contents. The 
cequest sentence is, for example, ^REQUEST: Lack of Pages 
corresponding to Open Circles- Please provide relating 
materials - " - Then the scenario converting unit 310 converts 
the scenario into the exhibiting electronic document such as 
a HTML (Hyper Text Markup Language) document - The exhibiting 
electronic document includes materials represented by the text 
data sets , The exhibiting electronic document and multimedia 
data except for the text data sets are supplied to the connecting 
unit 311 . 

The connecting unit 311 is, for example, a modem and 
uploads the exhibiting electronic document and the multimedia 
data to r for example, a WWW server connected to the internet ♦ 
Thus the multimedia contents exhibits on the computer network 
and present them to the clients - 

Each of the client can watch the table of the contents 
by the use of a WWW browser and can watch the content page by 
the clicking the link button. For example, the www browser 
shows the table of the contents and the content page as 
illustrated in Pig. 9A and 9B, respectively - 
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The connecting unit -311 "further checks the supplier 
information memory 314. If an electronic mail address is 
included, in the supplier information memorised in the supplier 
information memory 314, the presenting unit 311 send an email 
to request the lacking multimedia, data. 

Now, it is assumed that one of the clients sent an email 
as shown in Pig. 10 to the scenario editing device. 

The additional data receiving unit 312 receives the email 
and analyze the email . The additional data receiving unit 312 
picks out a picture (i.e. an image data set) and its caption 
(i.e. a text data set) from the email and recognizes that the 
picture shows a landscape of the spot A in 1990. The picture 
and the caption is supplied to the scenario supplementing unit 
313 together with the recognised information. Moreover, the 
additional data receiving unit 312 picks out the supplier 
information, receiving da to information, source address of the 
email and stores these information into the supplier 
information memory 314 . The supplier information memory 314 
memorizes the supplier information as shown in Pig. 11. 

Wien the scenario supplementing unit 313 receives the 
additional data sets representing the picture and the caption, 
it refers to the scenario basic rule memorized in the scenario 
rule memory 307 to produce the additional scenario 
corresponding to the additional data sets . The scenario 
supplementing unit 313 further changes the scenario memorized 
in tho scenario memory 305 to incorporate the additional 
scenario to the memorised scenario. That is f the scenario 
supplementing unit 313 produces a data tahle 003 as shown in 
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Fig . 12D and changes the main table as shown in Fig , 12A according 
to the scenario basic rules of "MAKE A CONTENT PACE EVERY 
COMBINATION OF SPOT AND YEAR" and "FOLLOW THE PAGE OF *SPOT C, 
1980"". Then the scenario supplementing unit 313 changes the 
data table 001 according to the scenario basic rules of 
"CLASSIFY RECEIVED DATA, ACCORDING TO YEARS OF 1970 , 1980 , 1990 , 
AND 2000" , "CLASSIFY RECEIVED DATA ACCORDING TO SPOTS OF A, B, 
C , AND D" , and ^LOCATE A BUTTON ACCORDING TO EQUATION F" as shown 
in Fig . 12B to locate a link: button relating to the content page 
of u SPOT A, 1990" on the page of "TABLE OF CONTENTS rr - As shown 
in Fig. 12C, the data table 002 corresponding to the content 
page of "SPOT C f 1980" is not changed by the scenario 
supplementing unit 313 in this event. 

When the scenario memorised in the scenario memory 305 
is renewed by the scenario supplementing unit 313, the scenario 
analyzing unit 308 analyses the renewed scenario and renew the 
scenario complete degree information memorized in the scenario 
complete degree memory 309. The renewed scenario complete 
degree information is shown in Fig. 13. Compared with Fig. 8, 
"SPOT A, 1990" is erased from the column of the lacking page 
and tine scenario complete rate is changed to 2/16 in Fig. 13. 

When the scenario and the scenario complete degree 
information are renewed r the scenario converting unit converts 
the renewed scenario into a renewed eaehibiting electronic 
document. The contents presenting unit 311 upload the renewed 
^DchdJbiting ©lects?onic document and the multimedia data to the 
www server . 
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The WWW browse can show the renewed table of the contents 
as shown in Fig. 14A. If the link button relating to the content 
page of M SPOT a, 1990" is clicked, the WWW browser shows the 
content page of fl SPOT A, 1990" as shown in Fig. 14B. 
Additionally r if ttue scenario basic rule includes a rule of 
^DXSPXAY NAME OF SUPPLIER" , the content page of the ^SEOT A, 
1990" includes a sentence of « SUPPLIED BY NICHIDEN TARO" . 
Heedless to say, when the link button relating to the content 
page of *SE>OT C, 1980" is clicked, the WWW browser shows ttxe 
content page of x *SPOT C, 1990" as shown in Fig. 9B, 

A3 mentioned above , the scenario editing device 
automatically renews the scenario memorized in scenario memory 
305 whenever additional data sets are supplied from the clients . 
In addition , the scenario editing device renews the multimedia 
contents exhibiting on the computer network whenever the 
scenario is renewed . Thus - the scenario editing device 
automatically enriches the multimedia contents to achieve the 
complete state of the multimedia contents. 

Since the scenario basic rule has no completion condition 
in above description, tne scenario editing device continues the 
operation forever. Therefore, it is necessary to add a rule 
for stopping ttie operation of the scenario editing device to 
the scenario basic rule memorized, in the scenario rule memory 
307. TIiq additional rule is as, for example, «if once ttxe 
content page is made, don' t renew the content page. " . In this 
<»s€t, the scexxaxio supplementing unit 313 rejects the 
additional multimedia data relating to the content page which 
is already made. 
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While this invention has thus for been described in 
conjunction with the preferred embodiment thereof , it will 
readily be possilala for those skilled in the art to put this 
invention into practice in various other manners . For example , 
the input/output control unit 303 , the scenario editing unit 
304 , the scenario rule editing unit 306, the scenario analyzing 
unit 308 , the scenario converting unit 310, the contents 
presenting unit 311, the additional data receiving unit 312 , 
and the scenario supplementing unit 313 are realized by a 
software or a computer prog-ram. The computer program secures 
memory areas for the scenario memory 305, the scenario rule 
memory 307, the scenario complete degree memory 309 r ana: the 
supplier information memory 314 in a memory device (not shown) 
of the personal computer. Though the computer program is 
generally recorded in a recording o^diuxa such as a a 
flexible magnetic recording medium, or a semiconductor memory, 
it may be memorised in a server such as the WWW server. 

Moreover, the output device may be used for presenting 
the multimedia contents to the clients . In this case , the 
connecting unit 311 may be a memory substituting for the www 
server . 
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WHAT IS CI^kXMRD IS 1 

1, A scenario editing device for editing a scenario o£ 
multimedia contents wJiich include a plurality of materials 
represented by data sets r said scenario editing- device 
comprising: 

a scenario merooary for memorizing the scenario , 

a scenario rule memory for memorizing a scenario basic 
rule which, defines specifications of a complete state of the 
multimedia, contents , 

a receiving -unit for receiving an additional data set 
which represents an additional material necessary to complete 
the multimedia contents , and 

a scenario supplementing unit connected to said scenario 
memory , said scenario rale memory, and said receiving unit for 
supplementing the scenario according to the scenario basic rule 
so -chat the additional material is included in the multimedia 
contents to make the multimedia, contents approach the complete 
state. 

2 . A scenario editing device as claim in Claim 1 , wherein 
said scenario editing device further comprises a scenario 
converting unit connected to said scenario memory and said 
scenario rule memory for converting the scenario memorized in 
said, scenario memory with referring to the scenario basic rule 
into an exhibiting electronic document which is used for 
exhibiting the multimedia contents . 

3 . A scenario editing device as claimed in Claim 2 , 
wherein said scenario editing device further comprises a 
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connecting tmit connected to the scenario converting unit for 
connecting the scenario converting unit to a computer network 
to eathibit the multimedia, contents on said computer network, 

4- & scenario editing device as claimed in Claim 3, 
wherein said receiving unit is connected to said computer 
network to receive the additional data set through said computer 
network • 

5 - A scenario editing ojevice as claimed in Claim 2 , 
wherein said scenario editing device further comprises a 
scenario analysing unit connected to said scenario memory, said 
scenario rule memory, and said scenario converting unit for 
analysing the scenario memorised in the scenario memory with 
referring to the scenario basic rule memorized in the scenario 
rule memory to produce a lacking data list and to supply the 
lacking data list for said scenario converting unit, anal 

said scenario converting unit including the lacking data 
list with the multimedia contents as one of the materials „ 

6 . A scenario editing device as claimed in Claim 5 , said 
scenario editing device further comprising a scenario 
completion degree information memory which is connected between 
said, scenario analyzing unit and said scenario converting unit 
to memorize the lacking data list as completion degree 

inf ormati on , wherein 

said scenario analyzing unit renews the scenario 
completion degree information whenever said receiving unit 
x«sc:esivTi=;& -fch® additional data set. 

7 » A scenario editing device as claimed in Claim X t said 
scenario editing device further comprises a scenario editing 
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unit connected to said scenario memory for producing and editing 
nine scenario . 

8 . A scenario editing device as claimed in Claim 1 , said 
scenario editing device further comprises a scenario basic irule 
editing unit connected to said scenario rule memory for 
producing and editing the scenario basic rule. 

9. A scenario editing device for editing a scenario of 
multimedia contents which, are presented to a client through a 
computer network and which include a plurality of materials 
represented by data sets, said scenario editing device 
comprising : 

a scenario memory for memorizing the scenario , 
presenting means connected to said scenario memory and 
said computer network for presenting the multimedia contents 
to the client by the use o£ the scenario memorized in scenario 
memory/ 

a receiving unit for receiving an additional data set 
which is supplied from the client and which represents an 
additional material, and 

a scenario supplementing unit connected to said scenario 
memory and said receiving unit for supplementing the scenario 
memorized in said scenario memory so that the additional 
material represented by the additional data set is included in 
the multimedia contents . 

10. A scenario editing device as claimed in Claim 9 , 
vrti<=»r@ixx *?a.id presenting moa*xs has a scenario converting unit 
and'an connecting unit, : 

said scenario converting unit connected to said scenario 
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memory for converting the scenario memorized in said scenario 
memory into an exhibiting* electronic document, and 

said, connecting unit connected to said scenario 
converting unit for connecting said scenario converting unit 
to staid computer network to present the multimedia contents to 
the client through said computer network. 

11 . A scenario editing device as claimed in Claim 9 , 
wherein said receiving unit is connected to said computer 
network to receive the additional data set from the client 
through said computer network. 

12 . A scenario editing device as claimed in Claim 9 , said 
scenario editing device further comprising a scenario rule 
memory connected to said scenario supplementing unit for 
memorizing a scenario basic rule defining specifications of a 
complete state of the multimedia contents , wherein 

said scenario supplementing unit supplements the 
scenario according to the scenario basic rule. 

13 . A scenario editing device aa claimed in Claim 12 r 
wherein said scenario editing device further comprises a 
scenario analyzing unit connected to said scenario memory, said 
scenario rule memory, and said presenting means for analyzing 
the scenario with referring to the scenario basic rule memorised 
in the scenario rule memory to produce a lacking data list and 
to supply the lacking data list for said presenting means , and 

said presenting means presenting the lacking data list 
as on© of the materials of the multimedia contents - 

14 . A scenario editing device as claimed in Claim 13 1 
said scenario editing device further comprising a scenario 
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completion degree information memory which is connected between 
said scenario analyzing unit and said, presenting means to 
memorize thd lacking data list as completion degree information , 
wherein 

said scenario analyzing unit renews the scenario 
completion degree information whenever said receiving unit 
receives the additional data set- 

15 • A scenario editing device as claimed in Claim 9 , said 
scenario editing device further comprises a scenario editing 
unit connected to said scenario memory for producing and editing 
the scenario* 

16 . A scenario editing device as claimed in Claim 9 , said 
scenario editing device further comprises a scenario basic rule 
editing unit connected to said scenario rule memory for 
producing and editing the scenario basic rule. 

17 A recording medium in which a computer readable 
program is recorded, said computer readable program comprising 
the steps of : 

memorizing/ in a scenario memory, a scenario of 
multimedia contents which include a plurality of materials 
represented by data sets , 

memorising, in a scenario rule memory, a scenario basic 
rule which defines specifications of a complete state of the 
mial-timedia contents , 

receiving, by a receiving unit, an additional data set 
which represents an additional roa-terial necessary to complete 
the multimedia contents, and 

supplementing, at a scenario supplementing unit , the 
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scenario according to the scenario basic rule so that the 
adtiitional material is included in the multimedia contents to 
male© the multimedia contents approach the complete state. 

18 . A recording medium as claimed in Claim 17 , wherein 
said program further comprises the step of converting, at a 
scenario converting unit, the scenario memorized in said 
scenario memory with referring to the scenario basic rule into 
an exhibiting electronic document which is used for exhibiting 
the multimedia contents. 

19. A recording medium as claimed in Claim 18, wherein 
said program further comprises the step of exhibiting the 
electronic document on a computer network. 

20 . A recording medium as claimed in Claim 19 , wherein 
the receiving unit receives the additional data set through said 
computer network at the receiving step* 

21. A recording medium as claimed in Claim IS, wherein 
said program further comprises the steps of: 

diialyaing the scenario memorized in the scenario memory 
with referring to the scenario basic rule memorised in the 
scenario rule memory to produce a lacking data list and to supply 
the lacking data list for said scenario converting unit, and 

including the lading data list with the multimedia 
contents as one of the materials at said scenario converting 
unit . 

22. A recording medium as claimed in Claim 21, wherein 
staid program fwrthor comprises the steps of: 

memorizing the lacking data list as completion degree 
information in a scenario completion degree information memory , 
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and 

renewing, at said scenario analyzing unit, the scenario 
completion degree information whenever said receiving unit 
receives tine additional data set. 

23 . A recording medium as claimed in Claim 17 , wherein 
the program fur ther comprises the. step of producing the scenario 
at a scenario editing unit to memorize the scenario into the 
scenario memory. 

24 . A recording medium as claimed in Claim 17 r wherein 
the program further comprises the step of producing the scenario 
basic rule at a scenario rule editing unit to memorize the 
scenario basic rule into the scenario rule memory , 
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ABSTRACT THE DISCLOSURE 

A scenario editing device comprises a scenario 
supplementing unit supplements a scenario memorized in a 
scenario memory according to a scenario basic rule memorized 
in a scenario rule memory when it receives additional data set 
from a receiving unit. The scenario supplementing unit 
includes a material represented by the additional data set with 
multimedia contents to make the multimedia contents approach 
a complete state. To receive the additional data set at the 
receiving unit, the scenario editing device exhibits the 
multimedia, contents with a incomplete state on a computer 
network . 
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Jpuli Name ot First or Sole inventor 
DAI GO TAGUCHI 


Signature ot" First or Sole Invemor 


Date 
March 6 , 

2.000 


Residence Address u 
Tokyo, Japan 


/Country ot Citizenship 

Japan 


Post Otfjice Address — 

c/o NEC Corporation, 7-1, Shiha 5-ciiome, Minato-ku, Tokyo, Japan 


Full Name or second inventor 
HISASHI NQDA 


Signature of Second Inventor 


Date 
March 6 , 
2000 


Kesiaence Address — 
Tokyo , Japan 


Country or ouzenshi 
Japan 


P 


Fost Otnce Address 

c/o TOC Corporation, 7-X„ Shiha 5-chome, Mlnato-ku, Tokyo* Japan 



Full Name of Third Inventor " " 


Signature of Third Inventor 


Date 


Residence Address 


Country or CRifcenshi 


P 


Host uiiice Address 



Full Name of Fourth Inventor 

Residence Address 



Signature oiT'f^burth Inventor 



Post Office Address 



Dace 



Country or Citizenship 



Full Name of Fifth Inventor 


Signature of Fifth Inventor 


Date 


Residence Address 


Country of Citizenshi 


P 


Post Ottice Address — 
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